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This  is  the  final  report  on  Contract  DAAG- 29- 81 -K-0168  entitled 
"Statistical  Selection  Procedures  "  The  report  covers  the  period 
September  1,  1981  through  September  15,  1965.  This  contract  with  a 
total  budget  of  $175,000  was  originally  planned  to  cover  the  3-year 
period  from  September  1,  1981  through  August  31,  1984;  a  no-new- funds 
extension  was  granted  to  continue  research  through  September  15,  1985. 
The  contract  is  a  follow-up  to  Contract  DAAG-29-81-C-0036  (and  earlier 
ones)  which  had  similar  missions.  Because  of  the  closeness  of  the 
objectives  of  these  contracts,  the  present  report  lists  some  articles 
the  research  for  which  was  initiated  or  completed  under  the  earlier 
contract,  but  which  were  not  completed  or  published  until  after  the 
final  report  of  that  contract  was  submitted. 

The  following  pages  describe  briefly  some  of  the  research  results 
and  list  the  papers  published  (and  those  accepted  for  publication)  with 
the  full  or  partial  support  of  these  contracts.  The  contents  of  most  of 
these  papers  have  already  been  described  in  detail  in  the  ei^t 
Semi-Annual  Progress  Reports  covering  the  4 -year  period  of  performance 
of  the  contract. 
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RESEARCH  ON  CONTRACT  DAAC-29'81 -K-016B 


On^  of  the  main  thrusts  of  new  research  on  the  present  contract 
stems  from  a  selection  problem  associated  with  quantal  response  curves. 
The  statistical  model  underlying  the  quantal  response  curve  problem  was 
described  in  detail  in  the  Semi-Annual  Progress  Report  on  the 
predecessor  contract  DAAG-29-80-C-0036  dated  June  30,  1980.  It  was 
pointed  out  there  that  if  certain  assumptions  hold  for  the  k  2  2 
quantal  response  curves,  then  the  selection  problem  for  the  k  quantal 
response  curves  can  be  solved  by  solving  an  associated  selection  problem 
for  k  >  2  Bernoulli  populations.  (A  follow-up  in  depth  study  of  the 
original  problem  was  carried  out  by  Dr.  A.  C.  Tamhane ,  and  reported  on 
in  "A  survey  of  literature  on  estimation  methods  for  quantal  response 
curves  with  a  view  toward  applying  them  to  the  problem  of  selecting  the 
curve  with  the  smallest  q-quantile  (Ed  lOOq),*  TR  No.  614  (December 
1983);  this  article  has  since  been  accepted  for  publication  in 
Communications  In  Statistics.  In  his  article  Tamhane  assessed  the 
difficulties  associated  with  finding  a  solution  (other  than  the  one 
mentioned  above)  to  the  original  problem.) 

Recognition  of  the  fact  that  a  solution  to  the  Bernoulli  selection 
problem  leads  (under  appropriate  assumptions)  to  a  solution  of  the 
quantal  response  selection  problem  suggested  that  intensive  study  of  thi 
former  problem  would  be  profitable.  Such  a  study  was  initiated  by  the 
P.l.  along  with  Dr.  Radhika  Kulkarni,  then  one  of  his  Ph.D  students. 
Their  study  lead  to  a  major  research  breakthrough;  namely  an  optimal 
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population.  Thair  findings  are  not  only  relevant  to  the  quantile 
selection  problen,  but  are  also  very  Important  in  their  own  right- - 
e.g.,  in  vendor  selection  and  in  clinical  trials.  Subsequent  papers  by 
the  P.I.  and  his  co- researchers  and  others  studied  in  depth  the 
properties  of  the  procedure  and  its  performance  characteristics.  These 
papers  are  listed  chronologically  in  the  following  pages  under  the 
heading  "References  on  the  Bechhofer-Kulkarni  Bernoulli  selection 
procedure."  The  results  have  been  presented  at  professional  meetings, 
both  theoretical  and  applied,  and  were  very  well  received.  The  P.I.  and 
his  co-workers  are  continuing  study  of  this  procedure  and  several 
variants  of  it. 

Results  obtained  on  the  Bernoulli  selection  problem  have  led  to 
related  results  on  the  problem  of  selecting  the  multinomial  event  which 
has  the  largest  probability.  Several  articles  have  been  published  on 
this  subject  by  the  P.I.  along  with  Drs.  David  Coldsman  and  Radhika 
Kulkarni .  Research  on  this  problem  is  continuing. 

A  third  major  area  of  research  initiated  by  the  P.I.  and 
Dr.  A.  C.  Tamhane  involved  the  use  and  construction  of  a  new  class  of 
incomplete  block  designs,  which  they  termed  balanced  treatment 
incomplete  block  (BTIB)  designs  for  comparing  several  test  treatments 
with  a  control  treatment.  Their  fundamental  paper  on  this  subject  was 
published  in  Technometrics  (1981)  (Corrigendum,  Technometrics  (1982), 

2^,  171)  with  follow-up  papers  in  Sankhva  (1983)  and  in  Selected  Tables 
in  Mathematical  Statistics  (1985).  Their  studies  of  this  problem  have 
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l*d  to  further  related  inveatl gat Iona  by  many  other  reaearch  workera.  A 
partial  list  of  some  of  the  additional  articles  published  on  this 
subject  is  given  in  the  following  pages  under  the  heading  "Additional 
references  on  balanced  treataent  Incoaplete  block  (BTIB)  designs.”  At 
the  present  tiae  the  P.I.  does  not  conteaplate  further  studies  of  this 
problem. 

The  P.I.  has  subaitted  a  research  proposal  to  ARO-D  to  pursue  new 
investigations  in  some  of  the  areas  described  above  and  in  related  ores, 
and  to  further  exploit  research  findings  already  obtained.  The  P.I. 
also  proposed  to  write  a  short  monograph  on  Bernoulli  selection 
procedures  with  special  reference  to  the  Bechhofer-Kulkarni  closed 
adaptive  sequential  procedure.  The  monograph  would  be  Intended  for  use 
by  practitioners;  tables  of  constants  necessary  to  lapleaent  the 
procedures,  and  tables  describing  the  performance  characteristics  of  the 
procedures  will  be  furnished.  As  presently  conceived  the  monograph  will 
contain  theorems  but  no  proofs.  The  P.I.  along  with  his  colleague, 
Professor  Thomas  J.  Santner  of  the  School  of  Operations  Research  and 
Industrial  Engineering  at  Cornell,  also  plans  to  write  a  monograph  on 
statistical  selection  procedures.  The  theme  of  the  book  would  be 
alternatives  to  hypothesis  testing- -specifically  selection  and  multiple 
comparisons  with  emphasis  on  the  former.  It  would  presume  a 
two- semester  course  in  statistical  me* hods  through  analysis  of  variance 
and  factorial  experiments.  Tlie  emphasis  would  be  on  relevant  procedures 
and  their  properties  but  not  on  proofs.  Tables  of  constants  necessary 
to  implement  the  procedures  will  be  provided. 


The  year  1984  narked  Che  30ch  annlveraary  of  Che  fine  published 


paper  on  Che  so-called  "Indifference-zone"  approach  Co  ranking  and 
selecCion  (Bechhofer,  R.E.  (1984).  "A  single  sample  mulciple  decision 
procedure  for  ranking  means  of  normal  populaCions  wlch  known  variances,” 
Annals  of  Mathemacical  SCacisCics.  25,  16-39).  In  celebraCion  of  Chis 
anniversary  Che  P.I.  was  asked  Co  wriCe  an  arCicle  surveying  che 
progress  made  Co  dace  and  highlighclng  some  of  Che  more  imporCanC  papers 
wriCCen  during  chis  period.  Professors  ShanCi  S.  Cupca  and 
S.  Panchapakesan  have  wriccen  a  companion  arcicle  vich  parclcular 
reference  to  the  "subset"  approach  These  will  appear  in  a  special 
issue  of  Che  American  Journal  of  Mathematical  and  Management  Sciences. 
The  issue  is  titled  "Statistical  ranking  and  selection:  three  decades 
of  development." 

AC  this  time  Che  P.I.  would  like  to  express  his  thanks  to  Che  Army 
Research  Office  -  Durham  for  its  strong  support  of  this  research 
activity  over  many  years.  He  is  particularly  indebted  to 
Dr.  Robert  Launer  of  ARO-D  for  his  constant  interest  and  encouragement. 


! 


I 


REFERENCES  ON  THE  BECHHQFER-KULKARNl 
BERNOULLI  SELECTION  PROCEDURE 


Sobel ,  M.  and  Huyett,  M.  (1957).  Selecting  the  best  one  of  several 

binomial  populations.  Bell  System  Technical  Journal.  36,  537-576. 

Kulkarni ,  R.V.  (1981).  Closed  adaptive  sequential  procedures  for 

selecting  the  best  of  k  s  2  Bernoulli  populations.  Unpublished 
Ph.D.  dissertation,  Cornell  University,  Ithaca,  New  York. 

Bechhofer,  R.E.  and  Kulkarni,  R.V.  (1982).  Closed  adaptive  sequential 

procedures  for  selecting  the  best  of  k  fc  2  Bernoulli  populations. 
Proceedings  of  the  Third  Purdue  SviPDosiuni  on  Statistical  Decision 
Theory  and  Related  Tonics  (ed.  by  S.S,  Gupta  and  J.  Berger),  New 
York,  Academic  Press,  1,  61-108. 

Bechhofer,  R.E.  and  Kulkarni,  R.V.  (1982-83).  On  the  performance 
characteristics  of  closed  adaptive  sequential  procedure  for 
selecting  the  best  Bernoulli  population.  Communications  in 
Statistics  -  Sequential  Analysis.  1(4),  315  -  354. 

Frisardi,  T.  (1982).  Monte  Carlo  experiments  with  a  closed  adaptive 
sequential  procedure  for  selecting  the  best  Bernoulli  population. 
M.S.  thesis,  Cornell  University,  Ithaca,  New  York. 

Bechhofer,  R.E.  and  Frisardi,  T.  (1983).  A  Monte  Carlo  study  of  the 

performance  of  a  closed  adaptive  sequential  procedure  for  selecting 
the  best  Bernoulli  population.  Journal  of  Statistical  Computation 
and  Simulation.  Vol.  18,  No.  2&3,  179  -  213. 

Jennison,  C.  (1983).  Equal  probability  of  correct  selection  for 
Bernoulli  selection  procedures.  Communications  in 
Statistics- -Theory  and  Methods.  A12,  24,  2887  -  2896. 

Jennison,  C.  (1984).  On  the  expected  sample  size  for  the 

Bechhofer-Kulkarni  Bernoulli  selection  procedure.  Communications 
in  Statistics  (C) -Sequential  Analysis.  3(1),  39  -  49. 

Jennison,  C.  and  Kulkarni,  R.V.  (1984).  Optimal  procedures  for 

selecting  the  best  s  out  of  k  Bernoulli  populations.  Design  of 
Experiments:  Ranking  and  Selection  (eds.  T.J.  Santner  and  A.C. 
Tamhane)  Marcel - Dekker ,  New  York,  113  -  125. 

Percus,  O.E.  and  Percus ,  J.K.  (1984).  On  the  Bechhofer-Kulkarni 

stopping  rule  for  sequential  clinical  trials.  SIAM  Journal  of 
Applied  Mathematics .  Vol.  44,  No.  6,  1164  -  1175. 

Bechhofer,  R.E.  (1985).  An  optimal  sequential  procedure  for  selecting 
the  best  Bernoulli  process- -a  review.  To  appear  in  the  Naval 
Research  Logistics  Quarterly  ,  32. 


6 


Kulkarnl ,  R.V.  and  Jennison,  C.  (1986).  Optlaal  properties  of  the 

Bechhofer-Kulkarni  Bernoulli  selection  procedure.  To  appear  in  the 
Annals  of  Statistics,  14  (March  1986) 

Kulkarni,  R.V.  and  Kulkarni ,  V.G.  (1985).  Optimal  Bayes  procedures  for 
selecting  the  better  of  two  Bernoulli  populations.  Technical  Report 
No.  UNC/ORSA/TR-85-6 .  Submitted  for  publication. 


ADDITIONAL  REFERENCES  ON  BALANCED  TREATMENT 
INCOMPLETE  BLOCK  (BTIB)  DESIGNS 

Ture,  T.  E.  (1982).  On  the  construction  and  optimality  of  balanced 

treatment  Incomplete  block  designs.  Ph.D.  dissertation.  Department 
of  Statistics,  University  of  California,  Berkeley. 

Notz,  W.  1.  and  Tamhane ,  A.  C.  (1983).  Balanced  treatment  incomplete 
block  (BTIB)  designs  for  comparing  treatments  with  a  control: 
Minimal  complete  sets  of  generator  designs  for  k  -  3,  p  -  3(1)10. 
Cominunlcations  in  Statistics.  Theory  and  Methods  12(12),  1391-1412. 

Majumdar,  D.  and  Notz,  W.  (1983).  Optimal  incomplete  block  designs  for 
comparing  treatments  with  a  control.  Annals  of  Statistics.  11, 
258-286. 

Hedayat,  A.  S.  and  Majumdar,  D.  (1984).  A-optimal  incomplete  block 

designs  for  control-test  treatment  comparisons.  Technometrics .  26, 
363-370. 

Hedayat,  A.  S.  and  Majumdar,  D.  (1985).  Families  of  A-optimal  block 
designs  for  comparing  test  treatments  with  a  control.  Annals  of 
Statistics .  13,  757-767. 

Notz,  W.  I.  (1985).  Optimal  designs  for  treatment-control  comparisons 
in  the  presence  of  two-way  heterogeneity.  Journal  of  Statistical 
Plannine  and  Inference .  12,  61-73. 

Ture,  T.  E.  (1985).  A-optimal  balanced  treatment  incomplete  block 

designs  for  multiple  comparisons  with  the  control.  International 
Statistical  Institute  meeting,  Amsterdam. 


'f 


ARO  contract  DAAG-29-81-K-0168 
for  bv  DAAC-29-80-C-0036  and  not 
listed  In  the  FINAL  REPORT  on  that  contract 
dated  July  31.  1981). 


Papers  (published  or  accented  for  publication^ 


Bechhofer,  R.  E.  and  Kulkarnl,  R.  V.  (1982).  Closed  adaptive  sequential 
procedures  for  selecting  the  best  of  k  2  2  Bernoulli  populations. 

In  Statistical  Decision  Theory  and  Related  Topics.  Ill  (ed.  by 
S.  S.  Gupta  and  J.  Berger),  Academic  Press,  61-108. 

Bechhofer,  R.  E.  and  Dunnett,  C.  W.  (1982).  Multiple  comparisons  for 

orthogonal  contrasts;  tables  and  applications.  Technometrics .  24, 
213-222. 

Bechhofer,  R.  E.  (1982).  In  memorlan,  Jack  Carl  Kiefer,  1924-1981.  The 
American  Statistician.  36,  356-357.  (Reprinted  In  Chinese  In 
Mathematics  In  Practice  and  Theory.  Academics  Slnlca,  Beijing, 

China,  Vol.  1  (1984),  76-80.) 

Bechhofer,  R.  E.  and  Kulkarnl,  R.  V.  (1982).  On  the  performance 

characteristics  of  a  closed  adaptive  sequential  procedure  for 
selecting  the  best  Bernoulli  population.  Sequential  Analysis. 
Communications  In  Statistics  (C) ,  I,  315-354. 

Bechhofer,  R.  E.  and  Tamhane,  A.  C.  (1983).  Incomplete  block  designs  for 
comparing  treatments  with  a  control  (II):  optimal  designs  for 
p  -  2(1)6,  k  -  2  and  p  -  3,  k  -  3.  Sankhva.  45,  Series  B, 
193-224. 

Bechhofer,  R.  E.  and  Tamhane,  A.  C.  (1983).  Design  of  experiments  for 

comparing  treatments  with  a  control;  tables  of  optimal  allocations 
of  observations.  Technometrics .  25,  87-95. 

Bechhofer,  R.  E.  and  Frisardi,  T.  (1983).  A  Monte  Carlo  study  of  the 

performance  of  a  closed  adaptive  sequential  procedure  for  selecting 
the  best  Bernoulli  population.  Journal  of  Statistical  Computation 
and  Simulation.  18,  179-213. 


7~k.”jfcr>  '-«  "v*  r-*  r^  "ji  1  7ij*  7am  J4r"  ir"  w— w  , 


Bechhofer,  R.  E.  and  Tamhane ,  A.  C.  (1984).  Tablet  of  admissible  and 
optimal  balanced  treatment  Incomplete  block  (BTIB)  designs  for 
comparing  treatments  with  a  control.  In  Selected  Tables  in 
Mathematical  Statistics.  8,  41-139. 

Bechhofer,  R.  E.  (1984).  Discussion  of  "Experimental  design;  review  and 
comment"  by  D.  M.  Steinberg  and  U.  G.  Hunter.  Technometrics .  26, 
125-127. 

Bechhofer,  R.  E.  and  Kulkarnl ,  R.  V.  (1984).  Closed  sequential 

procedures  for  selecting  the  multinomial  events  which  have  the 
largest  probaoillties .  Communications  in  Statistics  --  Theory  and 
Methods  A13  (24),  2997-3031. 

Bechhofer,  R.  E.  (1984).  An  optimal  sequential  Bernoulli  selection 
procedure.  In  Proceedings  of  the  Twentv-ninth  Conference  on  the 
Design  of  Experiments  in  Army  Research  Development  and  Testing.  ARO 
Report  84-2,  Part  2,  27-48. 

Bechhofer,  R.  E.  and  Goldsman,  D.  (1985).  On  the  Ramey-Alam  sequential 
procedure  for  selecting  the  multinomial  event  which  has  the  largest 
probability.  Communications  in  Statistics- -Simulation  and 
Computation .  B14(2),  263-282. 

Bechhofer,  R.  E.  and  Goldsman,  D.  (1985).  Truncation  of  the 

Bechhofer-Kiefer-Sobel  sequential  procedure  for  selecting  the 
multinomial  event  which  has  the  largest  probability.  Communications 
in  Statistics- -Simulation  and  Computation.  B14(2),  283-315. 

Bechhofer,  R.  E.  (1985).  An  optimal  sequential  procedure  for  selecting 
the  best  Bernoulli  process- -A  review.  To  appear  in  Naval  Research 
Logistics  Quarterly.  32 . 

Bechhofer,  R.  E.  (1985).  Selection  and  ranking  procedures- -some  personal 
reminiscences  and  thoughts  about  its  past,  present  and  future.  To 
appear  in  American  Journal  of  Mathematics  and  Management  Sciences. 

5,  No.  3  &  4. 

Faltin,  F.  W.  and  McCulloch,  C.  E.  (1983).  On  the  small-sample 

properties  of  the  Olkin-Sobel -Tong  estimator  of  the  probability  of 
correct  selection.  Journal  of  the  American  Statistical  Association. 
78,  464-467. 

Hayter,  A.  J.  (1984;.  A  proof  of  the  conjecture  that  the  Tukey-Kramer 

multiple  comparisons  procedure  is  conservative.  Annals  of  Statistic 
61-75. 


Jennison,  C.  (1983).  Equal  probability  of  correct  selection  for 
Bernoulli  selection  procedures.  Communications  in 
Statistics- -Theory  and  Methods.  12(24),  2887-2896. 


1C 


I 


Jennison,  C.  (1986).  On  the  expected  sample  size  for  the 

Bechhofer-Kulkarni  Bernoulli  selection  procedure.  Communications  Ir 
(C)  - -Sequential  Analysis.  3(1),  36-69. 

Kulkarni ,  R.  V.  and  Jennison,  C.  (1986).  Optimal  properties  of  the 

Bechhofer-Kulkarni  Bernoulli  selection  procedure.  To  appear  in  the 
Annals  of  Statistics.  16,  No.  1. 

Mah,  R.S.H.  and  Tamhane,  A.  C.  (1986).  Data  reconciliation  and  gross 
error  detection  in  chemical  process  networks.  To  appear  in 


McCulloch,  C.  E.  (1982).  Conditions  under  which  E(N^)  -  <*>  for  Tong's 

adaptive  solution  to  ranking  and  selection  problems.  Communications 
in  Statistics- -Theory  and  Methoas.  11(7),  815-819. 

Tamhane,  A.  C.  (1985).  Some  sequential  procedures  for  selecting  the 

better  Bernoulli  treatment  using  a  matched  samples  design.  Journal 
of  the  American  Statistical  Association.  80,  655-660. 

Tamhane,  A.  C.  (1986).  A  suirvey  of  literature  on  estimation  methods  for 
quantal  response  curves  with  a  view  toward  applying  them  to  the 
problem  of  selecting  the  curve  with  the  smallest  q-quantile  (ED 
lOOq) .  To  appear  in  Communications  In  Statistics--  Theory  and 


m  "  m  •  ^  ^ 


-r.  1 


> -yv -/-y 


Sl&duat?  stu'j?n>s  s^upported  In  part  bv  contract  DAAG  29-81-K-Q16I 
Thomas  Frisardl  Susan  Malila 


yi?UinL  Scientists  supported  In  part  bv  contract  DAAC-29-ei-K-Q 
Christopher  Jennison  Ajit  C.  Tamhane 


tl.S.  thesis,  the  research  for  which  was  support  In  part  bv 
contract  DAAG-29-81-K-0168 

Frisardi,  Thomas;  (M.S.  thesis)  "Monte  Carlo  experiments  with  a 
closed  adaptive  sequential  procedure  for  selecting  the  best  Bernoulli 
population."  January  1983. 


12 


FILMED 

J-84 


OTIC 


